Neuromorphic Eye-in-Hand Visual Servoing

نویسندگان

چکیده

Robotic vision plays a major role in factory automation to service robot applications. However, the traditional use of frame-based camera sets limitation on continuous visual feedback due their low sampling rate and redundant data real-time image processing, especially case high-speed tasks. Event cameras give human-like capabilities such as observing dynamic changes asynchronously at high temporal resolution ($1\mu s$) with latency wide range. In this paper, we present servoing method using an event switching control strategy explore, reach grasp achieve manipulation task. We devise three surface layers active events directly process stream from relative motion. A purely based approach is adopted extract corner features, localize them robustly heat maps generate virtual features for tracking alignment. Based feedback, motion controlled make upcoming converge desired spatio-temporal space. The controller switches its sequence operation establish stable grasp. (EVBS) validated experimentally commercial manipulator eye-in-hand configuration. Experiments prove effectiveness EBVS track objects different shapes without need re-tuning.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Eye-in-Hand/Eye-to-Hand Cooperation for Visual Servoing

The use of a camera in a robot control loop can be performed with two types of architecture: the camera is said eye-in-hand when rigidly mounted on the robot end-effector and it is said eyeto-hand when it observes the robot within its work space. These two schemes have technical differences and they can play very complementary parts. Obviously, the eye-in-hand one has a partial but precise sigh...

متن کامل

Uncalibrated Eye-in-Hand Visual Servoing

In this paper we present new uncalibrated control schemes for visionguided robotic tracking of a moving target using a moving camera. These control methods are applied to an uncalibrated robotic system with eye-in-hand visual feedback. Without a priori knowledge of the robot’s kinematic model or camera calibration, the system is able to track a moving object through a variety of motions and mai...

متن کامل

Visp: a Software Environment for Eye-in-hand Visual Servoing 2 Image Based Visual Servoing

In this paper, we describe a modular software that allows fast development of eye-in-hand image-based visual servoing applications (ViSP states for \Visual Servoing Platform"). Visual servoing consists in specifying a task as the regulation in the image of a set of visual features. Various issues have thus to considered in the design of such application: among these issues we nd the control of ...

متن کامل

Uncalibrated eye-in-hand visual servoing: an LMI approach

Purpose – The purpose of this paper is to present the control of six degrees of freedom (PUMA560) robotic arm using visual servoing, based upon linear matrix inequality (LMI). The aim lies in developing such a method that neither involves camera calibration parameters nor inverse kinematics. The approach adopted in this paper includes transpose Jacobian control; thus, inverse of the Jacobian ma...

متن کامل

VISP: A Software Environment for Eye-in-Hand Visual Servoing

In this paper, we describe a modular software that allows fast development of eye-in-hand image-based visual servoing applications (ViSP states for “Visual Servoing Platform”). Visual servoing consists in specifying a task as the regulation in the image of a set of visual features. Various issues have thus to considered in the design of such application: among these issues we find the control o...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2021

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2021.3071261